Detection of abnormal behaviour for dementia sufferers using Convolutional Neural Networks.

In recent years, there is a rapid increase in the population of elderly people. However, elderly people may suffer from the consequences of cognitive decline, which is a mental health disorder that primarily affects cognitive abilities such as learning, memory, etc. As a result, the elderly people may get dependent on caregivers to complete daily life tasks. Detecting the early indicators of dementia before it gets worsen and warning the caregivers and medical doctors would be helpful for further diagnosis. In this paper, the problem of activity recognition and abnormal behaviour detection is investigated for elderly people with dementia. First of all, the paper presents a methodology for generating synthetic data reflecting on some behavioural difficulties of people with dementia given the difficulty of obtaining real-world data. Secondly, the paper explores Convolutional Neural Networks (CNNs) to model patterns in activity sequences and detect abnormal behaviour related to dementia. Activity recognition is considered as a sequence labelling problem, while abnormal behaviour is flagged based on the deviation from normal patterns. Moreover, the performance of CNNs is compared against the state-of-art methods such as Naïve Bayes (NB), Hidden Markov Models (HMMs), Hidden Semi-Markov Models (HSMM), Conditional Random Fields (CRFs). The results obtained indicate that CNNs are competitive with those state-of-art methods

Cross-document word matching for segmentation and retrieval of Ottoman divans

Cataloged from PDF version of article.Motivated by the need for the automatic indexing and analysis of huge number of documents in Ottoman divan poetry, and for discovering new knowledge to preserve and make alive this heritage, in this study we propose a novel method for segmenting and retrieving words in Ottoman divans. Documents in Ottoman are dif- ficult to segment into words without a prior knowledge of the word. In this study, using the idea that divans have multiple copies (versions) by different writers in different writing styles, and word segmentation in some of those versions may be relatively easier to achieve than in other versions, segmentation of the versions (which are difficult, if not impossible, with traditional techniques) is performed using information carried from the simpler version. One version of a document is used as the source dataset and the other version of the same document is used as the target dataset. Words in the source dataset are automatically extracted and used as queries to be spotted in the target dataset for detecting word boundaries. We present the idea of cross-document word matching for a novel task of segmenting historical documents into words. We propose a matching scheme based on possible combinations of sequence of sub-words. We improve the performance of simple features through considering the words in a context. The method is applied on two versions of Layla and Majnun divan by Fuzuli. The results show that, the proposed word-matching-based segmentation method is promising in finding the word boundaries and in retrieving the words across documents

Abnormal Behaviour Detection for Dementia Sufferers via Transfer Learning and Recursive Auto-Encoders

—Cognitive impairment is one of the crucial problems elderly people face. Tracking their daily life activities and detecting early indicators of cognitive decline would be necessary for further diagnosis. Depending on the decline magnitude, monitoring may need to be done over long periods of time to detect abnormal behaviour. In the absence of training data, it would be helpful to learn the normal behaviour and daily life patterns of a (cognitively) healthy person and use them as a basis for tracking other patients. In this paper, we propose to investigate Recursive Auto-Encoders (RAE)-based transfer learning to cope with the problem of scarcity of data in the context of abnormal behaviour detection. We present a method for generating synthetic data to reflect on some behavior of people with dementia. An RAE model is trained on data of a healthy person in a source household. Then, the resulting RAE is used to detect abnormal behavior in a target house. To evaluate the proposed approach, we compare the results with the-state-ofthe-art supervised methods. The results indicate that transfer learning is promising when there is lack of training data

Detection of Dementia-Related Abnormal Behaviour Using Recursive Auto-Encoders.

Age-related health issues have been increasing with the rise of life expectancy all over the world. One of these problems is cognitive impairment, which causes elderly people to have problems performing their daily activities. Detection of cognitive impairment at an early stage would enable medical doctors to deepen diagnosis and follow-up on patient status. Recent studies show that daily activities can be used to assess the cognitive status of elderly people. Additionally, the intrinsic structure of activities and the relationships between their sub-activities are important clues for capturing the cognitive abilities of seniors. Existing methods perceive each activity as a stand-alone unit while ignoring their inner structural relationships. This study investigates such relationships by modelling activities hierarchically from their sub-activities, with the overall goal of detecting abnormal activities linked to cognitive impairment. For this purpose, recursive auto-encoders (RAE) and their linear vs. greedy and supervised vs. semi-supervised variants are adopted to model the activities. Then, abnormal activities are systematically detected using RAE's reconstruction error. Moreover, to apply RAEs for this problem, we introduce a new sensor representation called raw sensor measurement (RSM) that captures the intrinsic structure of activities, such as the frequency and the order of sensor activations. As real-world data are not accessible, we generated data by simulating abnormal behaviour, which reflects on cognitive impairment. Extensive experiments show that RAEs can be used as a decision-supporting tool, especially when the training set is not labelled to detect early indicators of dementia

Detecting indicators of cognitive impairment via Graph Convolutional Networks

While the life expectancy is on the rise all over the world, more people face health related problems such as cognitive decline. Dementia is a name used to describe progressive brain syndromes affecting memory, thinking, behaviour and emotion. People suffering from dementia may lose their abilities to perform daily life activities and they become on their caregivers. Hence, detecting the indicators of cognitive decline and warning the caregivers and medical doctors for further diagnosis would be helpful. In this study, we tackle the problem of activity recognition and abnormal behaviour detection in the context of dementia by observing daily life patterns of elderly people. Since there is no real-world data available, firstly a method is presented to simulate abnormal behaviour that can be observed in daily activity patterns of dementia sufferers. Secondly, Graph Convolutional Networks (GCNs) are exploited to recognise activities based on their granular-level sensor activations. Thirdly, abnormal behaviour related to dementia is detected using activity recognition confidence probabilities. Lastly, GCNs are compared against the state-of-the-art methods. The results obtained indicate that GCNs are able to recognise activities and flag abnormal behaviour related to dementia

Cross-document word matching for segmentation and retrieval of Ottoman divans

Motivated by the need for the automatic indexing and analysis of huge number of documents in Ottoman divan poetry, and for discovering new knowledge to preserve and make alive this heritage, in this study we propose a novel method for segmenting and retrieving words in Ottoman divans. Documents in Ottoman are difficult to segment into words without a prior knowledge of the word. In this study, using the idea that divans have multiple copies (versions) by different writers in different writing styles, and word segmentation in some of those versions may be relatively easier to achieve than in other versions, segmentation of the versions (which are difficult, if not impossible, with traditional techniques) is performed using information carried from the simpler version. One version of a document is used as the source dataset and the other version of the same document is used as the target dataset. Words in the source dataset are automatically extracted and used as queries to be spotted in the target dataset for detecting word boundaries. We present the idea of cross-document word matching for a novel task of segmenting historical documents into words. We propose a matching scheme based on possible combinations of sequence of sub-words. We improve the performance of simple features through considering the words in a context. The method is applied on two versions of Layla and Majnun divan by Fuzuli. The results show that, the proposed word-matching-based segmentation method is promising in finding the word boundaries and in retrieving the words across documents. © 2014, Springer-Verlag London

Matching Islamic patterns in Kufic images

In this study, we address the problem of matching patterns in Kufic calligraphy images. Being used as a decorative element, Kufic images have been designed in a way that makes it difficult to be read by non-experts. Therefore, available methods for handwriting recognition are not easily applicable to the recognition of Kufic patterns. In this study, we propose two new methods for Kufic pattern matching. The first method approximates the contours of connected components into lines and then utilizes chain code representation. Sequence matching techniques with a penalty for gaps are exploited for handling the variations between different instances of sub-patterns. In the second method, skeletons of connected components are represented as a graph where junction and end points are considered as nodes. Graph isomorphism techniques are then relaxed for partial graph matching. Methods are evaluated over a collection of 270 square Kufic images with 8,941 sub-patterns. Experimental results indicate that, besides retrieval and indexing of known patterns, our method also allows the discovery of new patterns. © 2015, Springer-Verlag London

Ethical Surveillance: Applying Deep Learning and Contextual Awareness for the Benefit of Persons Living with Dementia

A significant proportion of the population has become used to sharing private information on the internet with their friends. This information can leak throughout their social network and the extent that personal information propagates can depend on the privacy policy of large corporations. In an era of artificial intelligence, data mining, and cloud computing, is it necessary to share personal information with unidentified people? Our research shows that deep learning is possible using relatively low capacity computing. When applied, this demonstrates promising results in spatio-temporal positioning of subjects, in prediction of movement, and assessment of contextual risk. A private surveillance system is particularly suitable in the care of those who may be considered vulnerable

Long Short Term Memory Based Model for Abnormal Behavior Prediction in Elderly Persons

Smart home refers to the independency and comfort that are ensured by remote monitoring and assistive services. Assisting an elderly person requires identifying and accurately predicting his/her normal and abnormal behaviors. Abnormal behaviors observed during the completion of activities of daily living are a good indicator that the person is more likely to have health and behavioral problems that need intervention and assistance. In this paper, we propose a method, based on long short-term memory recurrent neural networks (LSTM), to automatically predicting an elderly person’s abnormal behaviors. Our method allows to model the temporal information expressed in the long sequences collected over time. Our study aims to evaluate the performance of LSTM on identifying and predicting elderly persons abnormal behaviors in smart homes. We experimentally demonstrated, through extensive experiments using a dataset, the suitability and performance of the proposed method in predicting abnormal behaviors with high accuracy. We also demonstrated the superiority of the proposed method compared to the existing state-of-the-art methods

A Survey on Ambient Sensor-Based Abnormal Behaviour Detection for Elderly People in Healthcare

Peer reviewed: TrueWith advances in machine learning and ambient sensors as well as the emergence of ambient assisted living (AAL), modeling humans’ abnormal behaviour patterns has become an important assistive technology for the rising elderly population in recent decades. Abnormal behaviour observed from daily activities can be an indicator of the consequences of a disease that the resident might suffer from or of the occurrence of a hazardous incident. Therefore, tracking daily life activities and detecting abnormal behaviour are significant in managing health conditions in a smart environment. This paper provides a comprehensive and in-depth review, focusing on the techniques that profile activities of daily living (ADL) and detect abnormal behaviour for healthcare. In particular, we discuss the definitions and examples of abnormal behaviour/activity in the healthcare of elderly people. We also describe the public ground-truth datasets along with approaches applied to produce synthetic data when no real-world data are available. We identify and describe the key facets of abnormal behaviour detection in a smart environment, with a particular focus on the ambient sensor types, datasets, data representations, conventional and deep learning-based abnormal behaviour detection methods. Finally, the survey discusses the challenges and open questions, which would be beneficial for researchers in the field to address.</jats:p